Papers with Fine-tuning pre-trained language models
LETI: Learning to Generate from Textual Interactions (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing techniques fine-tune on input-output pairs or with numerical rewards that gauge the output quality are not effective. |
| Approach: | They propose to fine-tune pre-trained language models with binary labels and a Python interpreter to get textual feedback from the inputs. |
| Outcome: | The proposed model outperforms the base model on unseen problems and achieves comparable or better performance on humanEval. |
RoAST: Robustifying Language Models via Adversarial Perturbation with Selective Training (2023.findings-emnlp)
Copied to clipboard
Jaehyung Kim, Yuning Mao, Rui Hou, Hanchao Yu, Davis Liang, Pascale Fung, Qifan Wang, Fuli Feng, Lifu Huang, Madian Khabsa
| Challenge: | Several perspectives of robustness for pre-trained language models have been studied independently, but lacking a unified consideration in multiple perspectives. |
| Approach: | They propose a technique to enhance the multi-perspective robustness of LMs by introducing adversarial perturbation while the model parameters are selectively updated upon their relative importance. |
| Outcome: | The proposed technique improves the robustness of LMs by incorporating four perspectives on model robustness. |
Formulating Few-shot Fine-tuning Towards Language Model Pre-training: A Pilot Study on Named Entity Recognition (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning pre-trained language models are limited . we propose a few-shot fine-uning framework for NER . |
| Approach: | They propose a few-shot fine-tuning framework for named entity recognition (NER) they propose three new types of tokens, "is-entity", "which-type" and "bracket" |
| Outcome: | The proposed framework improves on pre-trained language models on several benchmark datasets. |
Noise Stability Regularization for Improving BERT Fine-tuning (2021.naacl-main)
Copied to clipboard
| Challenge: | Recent studies show that fine-tuning pre-trained language models is unstable when there are only a small number of training samples available. |
| Approach: | They propose to use a method to regularize noise in deep nets to improve fine-tuning on NLP tasks. |
| Outcome: | The proposed method improves fine-tuning on natural language processing tasks by incorporating noise to the input and demonstrating generalizability and stability. |
Measuring the Instability of Fine-Tuning (2023.acl-long)
Copied to clipboard
| Challenge: | Many previous studies have investigated fine-tuning pre-trained language models on downstream tasks with varying random seeds, but they only used the standard deviation of performance scores (SD) as their measure, which is a narrow characterization of instability. |
| Approach: | They propose a systematic evaluation framework for the standard deviation of performance scores (SD) and six other measures quantifying instability of different granularity levels. |
| Outcome: | The proposed framework will be used to evaluate the validity of these measures and to improve them. |
One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning (2023.acl-long)
Copied to clipboard
| Challenge: | Parameter-efficient transfer learning methods can be expensive in storage when applied to broader ranges of tasks. |
| Approach: | They propose a method that enables efficient sharing of a single PETL network across layers and tasks. |
| Outcome: | The proposed method outperforms other methods with 10% parameters required by the latter on various downstream tasks. |
Knowledge Fusion By Evolving Weights of Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Experimental results on mainstream language models show that Evolver outperforms previous state-of-the-art models by large margins due to the high training costs of large language models. |
| Approach: | They propose a method to integrate multiple models from diverse training scenarios into a unified model. |
| Outcome: | The proposed method outperforms state-of-the-art models on mainstream language models by large margins. |